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development goals. Also, a synopsis of goa^. types and management 
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the needs assessment ^phase. The methods of assessing staff needs are 
.discussed, and assessment instruments are examined. Section III 
"describes how identified staff needs are translated in£olong and. 
shorf termVbjectives, and how activities are designed and 
implemented to satisfy those „ objective!. The choices available to the 
planner when matching program activities with specific training 
objectives are outlined. Described in the last section 'is the design 
of an evaluation plan for a staff development "program. Evaluation 
formats to aid in deciding whether the program >has satisfied staff 
needs and it alternative or additional activities need to be 
considered are discussed. Appendixes include a staff development 
checklist, a volunteer observation , form, a teacher. observation form, 
a general needs assessment form, a form for 'the ^participant's 
evaluation of inser.vrce, the HCEEP orientation conference 
questionnaire, a self assessment inventory, and examples of 
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INTRODUCTION 



.The principal goal of model demonstration projects, funded by the Handicapped Children ! s 
Early Education Program (HCEEP) is the development oi innovative educational programs for 
young handicapped;children and their famiUes. 'The process of developing and implementing 
*ew educational models invariably make* demands on the skills and knowledge of a project 
y*taff, necessitating training sorfhat staff members can understand and perform their' responsi- 
bilities in a demanding and changing educational environment. As a response to this need for 
L r ™n g> St - ff d ^ vel °P ment has been designated as one of the five major components* of all 
HCEEP model demonstration projects. ; 

All too frequently, staff development is not accorded the importance it deserves, nor are 
Staff development programs highly regarded within the field of education. The poor conception 
of this importan^component arises from the failure of many staff development endeavors and 
the dearth of ta^ible information on how to implement a successful program. Furthermore, 
staff development is' often a misused and misinterpreted term. While it is understandable that 
there is no universally accepted, workable definition which is applicable across educational, 
industrial, medical and busies settings, within the JiCEEP network the lack of a tangible 
definition of staff development and a concordant method for implementing staff development 
activities has been a manifest amission. As a response to this need, this monograph aspires to 
provide HCEEP demonstration projects with a basic understanding of what staff development is, 
to provide a description of the elements in a staff development cycle and to assist programs in 
designing effective and comprehensive staff development programs. - 

This monograph is' designed to be a working guide for projects who are designing and 
implementing staff development progr*is. It has four sections which correspond to the major 
phases in a staff development program. 1 

Section I presents a working definition of staff development and outlines the preliminary 
steps which must bejakeh before a program is. designed and administered. This section 
delineates the relationship between project gpals and. the goals of the staff development 
program. In addition, a synopsis of goal types and management structures are presented and 
discussed. > 

'Section II outlines the components of the needs assessment phase. The methods for 
assessing staff needs are discussed* and assessment instruments are examined, Section II 
-provides the* necessary information to answer the question: "What inservice education is 
needed, by whom, to what extertt, when and by what format?" (Marrs, 1981, p. 

Section HI describes how identified staff needs are translated into long- and shor-f-term 
objectives^ and how activities are designed and implemented to satisfy those objectives. 
Section III outlines the choices available to the staff development planner when matching 
program activities with specific training objectives. 

Section IV describes the desigi*%f an evaluation plan for a staff development program. 
Evaluation formats are discussed t& aid the planner ,in deciding whether the program has 
satisfied staff needs arid if alternative or additional activities need to be administered. 
\ * 
"The five components of HCEEP .demonstration' projects are: Staff Development; 
Services to Children; Services to' Parents; Administration and Management; 
Demonstration, Dissemination and Continuation* ; 
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•' J * SECTION I 

^ FOUNDATIONS FOR A SUCCESSFUL STAFF DEVELOPMENT PROGRAM 

- The importance of staff development for model demonstration programs*is self*evident. 

.Common sense dictates that if an innovative method of intervention or a new service-delivery 
model js designed, staff members will need training to understand and perform their job 
responsibilities. The need for training is ongoing, as model projects are expected to move 
through a cycle df developmental phases. Each new phase will require more. staff skills and, 
likewise, additional training. Staff development, in addition to providing a means for training" 
statt, will also laythe groundwork for .the demonstration/dissemination component of a model 
program when project staff teach other programs to replicate their model in another location. 
And linally, a successful staff development program can be considered a replicable element of 
an educational model. / 

Any effective staff development program for an HCEEI* project mustfmeet three types of 
goals: those of the fiscal agency or institution where the prbject is housed, those of the project 
itself and the personal and career goals of individual employees. In. order to" design a program 
capab e of the difficult task of meeting these three types of goals, it is necessary first to arrive 
at a clear and comprehensive definition of staff development. 

« « 

Staff Development Defined* 

x : „ . \ 

Arends, Hersh anU Turner (1980) state that "more productive staff development begins 
with the recognition that the concept. is complex" (p. 1).* Current dissatisfaction with staff 
deve opment practices fe related both to the difficulty of reducing the complex process of > 
developing an individual*fskills to simple elements and the lack of a specific definition of the 
term which ls applicable across multiple settings. That staff development is indeed 'complex is 
not questioned, but many HCEEP projects have developed excellent programs. And for the 
HCfctP network it is necessary to define staff development in a way that is broad enough to 
allow for individual .differences in HCEEP projects and narrow enough to provide necessary 
structure.- To satisfy these requirements, staff development^ defined as a systematic process 
lor planning and implementing directed change to improve behavicSrs and performances in order 
to meet the needs of in dividual staff members in concert with the philosophy and- goals of the 
organization . Staff development, depending on particular project goals, may encompass rrtore 
than is stated in the definition, but it may not encompass less. _ ' 
, . The clearest understanding of staff development is provided by examining the definition in 
detail. The term systematic process implies that staff development is more than an activity or 
series of activities. It is ah ongoing series of logical, sequential components that are carried 
out tn a cyclical manner, including planning, implementation and evaluation. Staff development- 
programs are intended to result in some type of change or growth; directed change indicates 
that the expected nature -of that change will be specified prior to the implementation of an 
a< ? 1V u lty, .„^ e last part of the deflation relates to the philosophy and goals of the organization 
which will dictate the direction that resultant changes x or growth should take. 

Broadly speaking, there are three types of growth associated with staff development 
(Joyce, Howey & Yarger, 1976). The first is, "the development of a human being whose growth 
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potentially enriches his/her relationships to children „and the kind's of instruction he or she is 
able to give" (pi 4). The second type of growth is referred to as u the improvement of the 
educators competence to carry out a particular role" (p. 4). The third type of growth refers to 
draining to better enable the educator to implement curricula^ and instructional reform 
decided on by thje persons responsible for the shape of the school in which the educator works" 
(p. Staff development should encompass all three types of growth b\it includes restrictions. 
A staff development program must accommodate both the needs of individuals and the neec^tof 
the organization. To separate one from the other negates the purpose of the program. * 

Demonstration Project Foundations 

A successful staff development prograrh,Jikfiu^i successful demonstration project, depends 
ori clear goals and a well-defined management smicture! The achievement of these two 
elements may, in a sense, be viewed as the first steps in a staff development plan. 

Project Goals. In clarifying a project 1 * goals, it is important to keep several things rfwriind. All 
HCEEP projects must respond to numerous goals and objectives. If the project is^ll defined, 
the goals of the host agency, individual staff and those of the project should be concqMant; and 
a singular staff development activity may satisfy all three requirements." General project.goals 
will provide a structure foT deciding on specific goals for the staff development program. But a 
project's goals will change over time. Each project has a life cycle; i.e., planning, model 
development, operation refinement, dissemination kf\d replication. Goals which are applicable 
to the project at inception may be quickly met and no longer apply to the future functioning of 
the project. During each of these phases, staff will be expected to perform tasks for which 
they may not have been prepared in their preservice or pre-emptoyment training. Provisions 
need to be made to'inforrrT staff of these changes and to provide on-the-job training foj 
developing the specific skills needed to perform these tasks. Over the life <srf the project,' 
original goals may be deleted, expanded or modified and new goals added, based on\the project's 
operational experience. 

When developing specific project goals, a strong case may be made for involving staff 
mergers in the process of goal refinement and objective development. Every member of a 
staff will bring into this decision-making process various structural and individual resources. 
Within any organization, information regarding process and function is differentially available, 
based on an individual's structural placement within that organization. In addition to these 
' structural resources, each staff member possesses individual resources which may include skills, 
knowledge, expertise, values and past experiences that may add to the store of information 
.from which decisions may be made. At a minimum, it is important that each staff member be 
aware of the goals', purposes and requirements of the project and his br her individual 
responsibilities toward attaining them. 

Project Management. There are a number of management systems used by hum^ ^service 
agencies, such as Critical Path Management (Horowitz, 196;), Management by Objectives 
(Reddin, 1971), Program Evaluation Review Technique (Horowitz J 1967) and the Discrepancy 
Evaluation Model (Yavorsky, 1978). None are good or bid per se, other than in the context of 
the organization and the function that the management system is expected to perform. 

Jhe key elements of any management system, as far as staff development is concerned, 
include the cle#r delineation of roles and responsibilities ind an understanding by project staff 
of the decision-making style of fhe organization. "Wherfces^ablishing a management system, it is 
essential to develop explicit job descriptions for each njWriber 0 f a staff. These should include 
all the activities an individual within a given role is expdjfcd to perform and should indicate the 
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desired outcome of those activities. ^The job descriptions may be negotiated with existing staff 
members or simply assigned. Clearly stated.job descriptions, along with clear project goals, are 
important foundations of a staff development program- ^ 

The basic components of the management system should include: 

A statement of- philosophy that expresses the basic beliefs and rationale for the 
operation of the agency. 

Goals that represent the annual'putcomes t6 which the agen$y aspires. 
Objectives that define specific outputs, have timelines, and measure the progress in 
achieving the goals. * . . 

Activities reflecting specific behaviors that £re assigned to individual staff mem- 
* bers that must be accomplished in order to meet the stated objectives. 

(NASDSE, 1979, p. 7) 

Staff Development Program Foundations 

Before planning the actual staff development program, two key preliminary decisions 
must be made: A management structure for the program must be selected; responsibility for 
directing staff development must be assigned. Second, the goal tVperof the program must be 
identified. , } 

Management Options. Planning of a staff^evelopment program involves selecting! program's 
management structure.^ Three management c^ions exist for staff development programs: 

Option^ Agency administrator 

Option Ji: A staff developmenftspecialist 

Option III: A committeetcopposed of various members of the agency staff 

Each option has* advantages and disadvantages which should be weighed when determining the 
most appropriate management system for a particular project. 

♦ ^ A * 

O£tion_l, Most projects hyhe HCEEP network rely on the project director or coordinator 
to design and implement the staff development program. Presumably,\<he$e administrators are 
well acquainted with the projects goals and management system ahcPhave considerable 
knowledge of the individual members of the project *taff. In addition, these administrators are 
probably invested with the authority^ initiate the staff development program. Two -major 
drawbacks to this approach includestime constraints and possible lack of staff involvement. The 
project administrator may be so burdened with responsibility that adequate^ time is not available 
to assume full responsibility for an entire staff development program. * Moreover, when the 
responsibility for staff development rests solely with the project administrator, the subsequent 
staff development program may be viewed as arbitrary, or it may lack a broad base of support, 
thus resulting^ staff indifference rather tfian staff commitment. 

°P tion !i* A staf f development specialist rtiay be a staff member who hfas been assigned 
staff development as a sole responsibility, or it may be an external consultant who has been 
contracted to perform this function. The potential advantages of using a specialist in this 
position include adequate time and expertise. In addition, the staff may view such a specialist 
as Joeing more objective than the project administrator. The disadvantages may include 
increased cost and the danger (particularly in the case of an external consultant) of lacl\ of 
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adequate familiarity with the goals and inner workings of the project. and with individual staff 
members. * . 

Optipn III . ,The major advantage of using a representative dommiftee to design and 
implement the staff development progranr^s that the broad-based staff input may result in 
greater support and commitment of individual* staff members. The disadvantages are those that 
always exist when working in a committee. -Planning may take considerably nrpre time, and the 
fragmentation of authority -may be" detrimental to the resultant program. To be successful, this 
approach must have the support of the project administrator, and the committee must be 
alloted adequate time and resources to complete its task. y 

Goal Types. Staff development programs generally focus on one of four types of goals: ^ 

Program Restructuring ; An inserflce program intended to restructure the' ongoing 
program andj calling for m*jor role changes on the part of personnel. It also has 
implication^ffla^organizational change. 

Program Modification ; Calls for substantial role changes on the part of personnel, 
although less radical than Program Restructuring. There are usually few," if any, major 
organizational changes inherent in program modification. 

ghogram/Skill Development ; Alters the program or aids personnel in developing new skills 
or improving existing ones. It typically requires little if any # alteration of either rt)les or 
organizational structure. v 

Exploratory ; The irttent of staff development may be to explore new approaches.' The 
resultant program is flexible, with a great deal of variation in quality. (Yarger et al., 
\ 1977, p. 1*) ' 

Within HCEEP demonstration projects, all four of the above goal types may be applicable 
to a staff development program. Because projects are responsible for developing educational 
models, however, the most appropriate goal type will be based op that model's developmental 
state. For example, in any well-developed demonstration model, jnservice training with a 
program/skill development goal is^always appropriate for new staff. In most model programs, 
there is a relatively standard, systematic approach to intervention, and new staff will need 
training in this approach, w&en a well-developed model undergoes change in any aspect of its 
approach, program restructuring or program modification will be the appropriate goal of its 
staff development program. To some degree, an exploratory iriservice program is appropriate, 
^within *the HCEEP network at all phases, since model development and refinement are inherent 
in the goals of each project. . When the exploratory * insfltvice approach is used in the early 
stages of model development, it is important ^hat strifct tlrne limitations be imposed for this 
exploration, or the model may never become fully developed. Care needs to be exercised with 
the exploratory approach in fully-developed npdels as wgll. Staff members engaged irr 
exploratory inservice training will probably be (exposed to ideologies or techniques that are 
incompatible with the model. While the model rrtay legitimately change as a result of this, Jhat 
change cannot be allowed to occur randpmly, bujt needs to occ&r in a systematic and controlled 
noanper. J 
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^ . . . SECOND • 

^ ^DEsfel^NG ANDttDMlMlSTERING J. 

, STAFF NEEDS ASSESSMENTS ' ■ 

The process of assessing staff development needs is the determinative step of a 

• "Productive staff development progra^i.. WhUe the preliminary planning stages-clarifying a 
- ✓ project s goals, delineating- a project's management system and establishing a management 

structure for the staff development program-set the groundwork for a successful program, 
* assessing staff needs,carries the process into its formative stage. How effective $e program is 
.and how useful it with be to- overall project development is dependent' on an accurate needs 
i assessment.^ . . / *^ * - * 

The general purpos.e oi a needs asSessn^nt is.tb identify current staff performance levels 

t . i2P^; CeS i„^ ffm ,f n i 19 J ?2 V defined * he needs assessment process as a discrepancy analysis, 
W '^Tiere\ "need" is identified as the distfepancy between the program standard and current 
' ^">P rac * lce - goals ' and ' obJ^^es "derived from the initial preplanning* stages for staff 

' development will serve, 3% the pfogra^ standard a*gainsf\hich actual performance (assessed 
performance levels) will be measured^ To'ciirequently, staff development activities have been 
~ . .desmned and implemented on the'w.him of 'an administrator, someone's guess as to what is 
' ' 2 6 u d 1? ° r b_ e ^ use it, sounded Ii& a good ideai(Wieck,.1979). According to Kaufman's definition- 

• . Jwfiich we have adopted) any activity intended to be, part of the«staff development process must 
* >ocedure£ n ^ dgv ^ ment ^^^ hat l?ave been identified through discrepancy analysis 

, ^A^arefully designed, and systematic needs, assessment process will yield data that provide 
' " d,rt ^""L&^^ program. The discrepancies identified as 

v ^-estttrof the netofe assessment ace translatedrby^taff development planners into behavioral 
objectives.Z5t.aff development activities .are then designed^nd implemented to' meet these 
objectives/ An accurat^eeds assessment will assist planners^ designing activities targeted 
specifically to me®t a .designated need.; , -^_^o^^ b 

u 76 JJ insure that retail development activities are based on actual^lta$f-nfieds and, 
furthermore, that, there is- a matching of the assessment instrument to a particular objective, 
^ three major -steps must be taken, Tlyese steps, offer standard methodologies for staff 
assessment and provide, -alternative choices for deigning and administering the staff needs 
assessment. The three major steps in designing an effective, comprehensive needs assessment 
are: -* 



Specification of content. ' 

Selection of needs assessment instrument 

Administering the needs assessment 



Specification of Content 



During the preliminary planning tor staff development, project goals ancUbjectives were 
delineated, role^descriptions were developed for each staff position and the overall goals for 
the staff development program were specified. Developing the content of^a needs assessment 
begins with listing a project's goals. These goals can be Woken into numerous objectives, then 
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into initial, or ongoing tasks to accomplish those objectives. A project's goals, for example, may 
be to provide young, developmentally delafyed. children with individualized programming using a 
specialized technique developed by the projectT From this goal, sev^al tasks are readily 
apparent: the child must be assessed, an Individual Educational Program* e (I&P) must be 
developed and instructional activities must be planned ^or selected and then implemented. The 
generation of a detailed, complete list of tasks necessary to meet* project objectives "will 
provide further specif ication'of the contenrto be addressed by a needs assessment. 

* There are several methods foe generating lists of tasks. Each, staff: member may 
individually list the tasks performed within the scope of his 'or-(ier job. If an external coh^kant 
i$ used, he or she iisyaUy^joter yiews each staff member to dete urup^he^Ve'akdowrr oTlasks 
within the project. However they are obtained, the individual lists are then Q?mbined into, a 
single list of tasks for each ]o\> \yithin the^project. The*rtiajor advantage of generating these 
lists individually is thnt Staff members may more freely express themselves. ' * 

The list of tasks may also be generated in gr6ups led by a faciiitatoc' In the group 
process, the staff members brainstorm and list each task. At the end of the brainstorming 
session, the group consolidates the list. Tasks that are the s.ame bCit have been worded 
differently are treated as one ta^k. Irrelevaffiutasks arp discarded and separate tasks that have 
beefi combined into one statement are specified individually. The major advantage of this' type 
of group process is that it stimulates thinking, thus resulting in a-more comprehensive listing. 
Very often, hearing another person's contribUtion.may result *in several other people exkftiming^ 
aspects of a job they, would otherwise hav^e overlooked* * ~ 

The individual- and group processes may also b^ combined.^ Individuals first develop a list 
of tasks which is then used as a staFt!ftg s poiht for the group process/ The primary advantage of 
this combined approach is that it may save time. > 1 

'vWhen a substantial list has been generated, the tasks can be grouped by category^Three 
categories frequently .identified by HCEEP projects jelate jto ^kilis, attitudes~6nd knowledge 
required to perform the task. Additionalcategaries usually follow a program's ^componeqts, 
i.e.,^child assessment, working with parents, intervention and treatment, interpersonal skilly 
administrative tasks, etc. Bishc3p (1976) describes seven general' categories that may be useful 
and applicable to- HCEEP demonstration projects: information, content/skill, competencies* 
resources and their'use,, organization, attitudes and process (p. 29-31). Categories selected 
must be relevant to project activities a% the purpose of thi% categorization is to reduce th§Jists* 
of tasks into discrete, manageable units. 

When the list of tasks has been generated and categorized, it is reviewed by all staff 
members, who may make further ^additions or deletions. Since the object of this endeavor is to 
compile the most complete and accurate list , possible, the review is essential. It is alsq good 
policy^to have the staff review the list periodically so it remains current. Job functions change 
over time, and these changes must be reflected in the list. Wh^n the staff reach a consensus . 
on the list, each categorized task needs to be e*amin^d. The performance of these tasks 
requires various informational, technical an£ interpersonal skills. v The knowledge and skill 
required for each task needs to be identified and, to the greatest extent possible, qualified and 
. quantified.. When this point ,is readied, decisions njay be made regarding the selection of the r 
most appropriate instruments for the needs assessment.' # 

i * \ 
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Selection breeds Assessment Instruments* 



p • There is a correspondence between the skill, knowledge or attitude addressed by the needs 
assessment and the.most appropriate assessment instrument.-' There are numerous assessment 
formats available, and each project should review them to choose the most appropriate one for 
a project s needs. The most commonly u&d are variations of a questionnaire format or 
observational techniques. ) • 

Questionnaire A questionnaire is the most common instrument used for conducting a needs 
assessment and can take* several forms. A simple checRlistquestionnaire is illustrated in^Figu^e 



, Figure 1 '' , 1 

Check those areas >jn which youfe'el the need for further training. 

• **-.*.• 
A. Child Assessment . , 

. . l * Ad mirvstering,' scoring and interpreting the Bay ley Scales of Infant Development. 

2. Administering, scoring and interpreting tffe Portage Checklist.' 

3. Writing reports summarizing assessment results." - \ 

JL *• Informing parents of the results of £he assessments.* 

' L ■' . 

A format like Figure 1 is quick and easy to administer and tabulate. Its major drawback' is 
•!v^ e S re g f hefed information can be uped for .staff development planning, the tasks 
withiri the general areas must be clarified, Sometimes a rather extensive task in itself. A ■ 
follow-up mterview, however, should help clarify needs. Por example, if the Baylef Scales item 
was checked, the interviewer would ask if training was needed in administratiortfscoring and/or 
interpretation An additional problem of the checklist questionnaire is its inability to indicate, 
priorities for the identified needs. , • * * ( 

-'The' same items listed in Figure 1-could be used, in a discrepancy model (NA5DSE, 1979) 
like Figure 2. In this instance respondents'are asked tp score each item twice, onc"e indicating 
the level of skill, or knowledge required to perform the task and once indicating their existing . 
skill or knowledge level. » , . .. " \ ■* ° 



Appendices A through D offer examples of commonly used needs assessment-instruments. 
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Figure 2 



Using the following scale, indicate for each item the level of skill or knowledge required for 
yotfr job performance in the first column and the existing level in the secpnd column. 



1 = none 



2 = minimal 



3 = moderate 



4 i considerable 5'= extensive 



-A. tChild Assessment 



<3 



Required 



Existing Discrepancy^ 











1. Administering, scoring and 
interpreting the Bayley Scales 
of Infant Development. . 

A " * > ' ' - 
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2. Administering, scoring and 
interpreting the Portage 
Checklist. 




\ 
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3. Writing reports summarizing 
assessment results. * 
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• * 
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4. Informing parents of the 
/ assessment results. 
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By subtracting the existing level frqfli the required level, a discrepancy score can be obtained. 
The larger the discrepancy, the greater the need. A questionnaire like this is best used in 
conjunction with an interview to further defihe identified needs. 

Another f^m of questionnaire is open^nded (Figure 3). Open-ended questionnaires do 
not limit the range of responses, nor do they slant or bias responses. Nevertheless, the time 
required of a respondent in completing an open-ended questionnaire is a m^jor drawback. 
Furthermore, while tfe open-eroded fprmat does not limit the range of responses, it may not ' 
provide enough structure, to* elicit the information sought. In addition, the information gained 
may be difficult to interpret. Open-ended questionnaires are most appropriately used with 
face-tb-face interviews and/or more structured questionnaires. 1 > 
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Figure 3 

J* ' 

Child Assessment J m m x 

« * 

^ 1. Please list any assessment instruments thit you feel in ne$d of further training in 
their administration, scoring, etc. ^ 

A. 1 . , 

n* * / 

T . \ 

C. . 1 , ' 

2. Do you have any concerns with your skills in interpreting assessment results?* 
(Explain) > * 4 



3. 



List any other c&hcerns ypu m ay ha ve iifche area of child assessment or any training 
you feel you need. ( ■ " BB *w 




Observation^|nother approach to conducting/a needs assessment is peer or supervisor observa- 
tion. Properly designed and impleme\pted»Jthis technique offers greater objectivity and may 
provide morej^detailed data th^n a questionnaire. Improperly used, however, it can be a 
threatening, detrimental &evice.__ _ , - ___ N 

i - * * 
Observation is only appropriate when the following conditions are meU 
I 

* - Behaviors arfe clearly defined 1 

- Behaviors to be measured are observable 
" - Criteria exist for each behavior 

- Int^-rater reliability is obtained on each measure * ' 

£ I r <jJm % * ^ 

A staff^ember'^ml in administering and scoring most standardized child assessment 
instruments is usually 9ksy to asses's by observation. A simple checklist (Figare 4) is easily 
constructed. » 
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Figure 4* 



Behavior Observed 



Tesfttem Number 
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Itenrt .administered according to k 
directions * a 
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Item consequated according to * 
directions " , ^ 
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Response recorded accurately 
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In this example, the four conditions for using observation are met. Standardized procedures for 
test administration clearly define observable behaviors .and state criterion levels for each. 
Inter-rater reliability is obtained by using a second observer 100% of the time or foi^a random^ 
sample of at least 20% of alt observations and figuring the^percent of agreement. 



inter-rater 



number of agreements 



X 100 



4 reliability number of agreements + the 

number of disagfgem€nts 

Another set of tasks that lends itself w§ll to observational assessment may ba part of a 
program f s intervention technique. Foi; example, an HCEEP project that^works with an 
autistic-like population has established a cleanly defined procedure for dealing with the 
stereotypic behavior prevalent in that^population. Within five seconds of the initiation of 
stereotypic behavior,' the teacher is* expected to interrupt the? behavior by first applying a 
mildly adversive stimulus (loud hand-clap, saying "stop," etc.) and then initiating" a program of 
movement with which the child has previously been successful. The program may consist of 
sitting, standing, jumping and clapping on command and is conducted two to three times in rapid 
succession* The child is then brought bac^c to an activity similar to the one in which he or she 
was engaged prior to the onset of the stereotypic behavior. This technique is easily observable 
and may be measured using a form similar tq the one shown in Figure 5. 
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Figure 5 



Instructions: This form is to be used for a 30- minute interval* Designate each tfGs^ved 
behavior in the apprqriate row with a hash mark. * " % 



Number of initiations of stereotypic behavior 



Number of interventions within the 5pSecond 
interval - , * r ' 



Number of interventions with an appropriate 
mild adversive 



Number of appropriate moveijrrent programs 
initiated* * 



Number of^C-entries into appropriate. activities- . ^ * 

Jn this example, the project has clearly defined the behaviors to be observed in both the teacher 
and the child. The criteria is clearly stated: intervention must occur within five seconds of the 
initiation of stereotypic behavior. Inter-rater reliability's easily obtained using the afore- 
mentioned procedure. . ^ 

The appropriate administration ' of a well-designed observation instrument can yield 
specific measurement of certain skills. In the development of a model program, this approach 
to assessing the skills of staff has aiv "additional advantage. F<Dr example, if a specific 
intervention. technique is the foundation or an essential element of the model, a highly objective 
observation instrurpe'nt allows for the measurement of .the intervention delivery. Individual 
teaching behavigrsl an4 styles have compounded the difficulty of data collection when 
attempting to compare the effectiveness of two or more intervention techniques.^ While the use 
of this objective measurement does not eliminate individual differences, it does serve to qualify 
and quantify the intervention method and greatly aid replication efforts. Used on a periodic 
basis, it allows for controlled modification in the model and reduces the possibility of random, 
variation. ' . 
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Administering the Needs Assessment 

In some cases, the instruments selected for assessing staff needs will determine how the 
assessment is best administered. However, in most circumstances, the staff development 
planner .has several choices. Needs assessments can be administered in the form of 
self -assessments, peer assessments, external assessments or some combination of these. Each 
has advantages and disadvantages that should be considered when selecting the type or 
combination of types most appropriate for a specific project. L, 

Self-Assessment In self -assessment, as the term implies, the individual conductions or her own 
needs assessment. Self-assessments generally involve the use of a questionnaire. An advantage 
qf self-administered assessment is that it allows for a maximum of privacy and may therefore 
encourage more straightforward responses (Miller & Verduin, 1979). This may lead to a more 
accurate identification of needs, thereby providing a better foundation for the staff develop- 
ment program. In addition, self-assessment may make a staff member feel more actively 
invalv'ed in theuentire staff development process. 

Self -assessments, however, also have limitations. Ficst, some people, as a result of years 
of supervision and evaluation are reluctant to perform self-assessments, (Miller & Verduin, 
1979). Moreover, many individuals when scoring a self-as§essroent questionnaire, tend to rate 
the needs of their peers' rather than their own. This projection is most likely to occur when the 
needs assessment instrument is simplist/c and vague, when, for example, it Jists only a variety 
of topical interest areas and asks the f'esiSpndent to indicate his or her areas of needs. If an 
individual's primary area of neetf is not listed and the individual does not perceive the areas 
listed as even moderately important, he or she is likely to think something like this: "I don't 
really need any of this, but from What Pve'seen of the rest of the staff, Gaining is really needed 
in THIS area." Another way individuals misrepresent their needs is to check those areas in 
vogue at the time, with little regard to whether ,or not training is really needed in that area. 

A third limitation, pos^bly the most serious because it is, difficult to discern, is that 
sell- appraisal may be-inaccur&te ^because the individual may not understand the skill-being 
measured. This shortcoming come^to light if the assessment is read ministered after training 
has occurred. If skills scored at the T^astery level during the first administration are scored as 
M need assistance" during the second, one\pf two things is probably true: either the individual did 
not see these skill areas as a high priority need during the first scoring, or he or she did not 
understand the level of skill required until receiving training in another area. The discrepancy 
could simply be a function o'f time- -the fckill had not been needed up to that point in time (e.g., 
wrttjng year rend reports), or the individual needed to learn, a foundation skill before recognizing" 
a lack in the secondary skill area^ 

Overall, self-administered assessments offer an individual ihe greatest opportunity for 
self -reflection and actualization, but when used\in exclusion of other types of administration, 
self -assessment may lack the desired objectivity. 

Peer Assessment Co-workers generally design andN^dminister peer assessments. Their major 
advantage is £hat if well constructed and administered, peer assessments are likely to be more 
objective and accurate than self-assessment. For example, when measuring a teacher's ability 
to reinforce child behavior according to a specified schedule, a peer trained in observational 
data collection Will obtain more accurate data than will the teacher performing a self -assess- 
ment. There are two reasons for this: it. would be difficult for the teacher to record a 
high-frequency behavior while in the process of emitting it, and a peer, being uninyolved with 
the teaching session, could observe with greater detachment. On the other hand, the peer 
assessment can be ineffective if the instrument used is overly subjective. Peer assessments are 
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usually conducted by observation, and observational forms generally require the observer to 
record behaviors dt specific intervals or' to note specific behaviors (Miller and Verduin, 1979). 

Assessments conducted by supervisors may also be considered a variety; of peer assess- 
ment. Because someone with greater authority administers the assessment, it may be viewed as 
an^fevaluation of performance rather than an assessment of need. A staffs member might be 
understandably reluctant to expose areas of need to the individual who is also responsible for 
future promotions and raising (or lowering) one's salary. . 



External Assessment An individual or group of individuals not directly associated with the 
organization administers external assessments. The two major advantages of external assess- 
ments are objectivity and prestige. If ah ^x^rnal consultant with extensive knowledge of the 
overall program administers the assessment, the result could be a more objective -assessment 
than possible with either self- or peer assessment. In addition, the external assessment may be 
viewed, by individuals both within and outside of the, organization, as being rnor^ prestigious and 
therefore may ha^e greater impact. This is generally true if the external consultant is well 
known and widely respected in the field. 

The drawbacks to using an external consultant are the expense and the difficulty of 
finding a consultant whp is familiar with the organization and who possesses all the necessary 
evaluative skills. Possibly the greatest shortcoming of the external assessment is that it tends 
to be something that is done "to" rather than "with" a staff. The commitment and involvement 
of the entire staff is critical to the success of an external assessment. If the sta^f feels little 
or no involvement with ttte assessment process and does not view the external consultant with a 
good deal of professional respect, the most objective assessment will Carry little weight. 

Combined Approaches to Administration In many cases, some combination of self-, peer and 
external administration of needs assessment may be the best approach. If time permits, the use 
of more than one administrative approach provides the opportunity to access more information 
and to minimize the drawbacks of any single approach. For example, in measuring a teachers 
skill at reinforcing be havi or, it is possible to use both peer and self-assessment. By videotaping 
a teaching session and then having both t^e teacher and a peer record data using an observation 
instrument, it is possible to actively involve the teacher in his or her own assessment, to 
provide a greater degree of objectivity than self -assessment alone and to create actuation for 
obtaining inter-rater reliability. 



Kaufman (1972) states that M no needs determination is final anh complete; we must 
realize that any statement of needs is in fact tentative,, and we should constantly question the 
validity of our needs statement" (p. 29). Since the entire needs assessment process is intended 
to provide an accurate identification of needs, it is essential that the validity of the process be 
examined. The staff development planner may go about this in a number of ways; one of the 
simplest methods is to ask staff members to evaluate the degree to which they feel the 
assessment accurately identified their needs. Another method involves examining the identified 
needs, the subsequent training and training objectives, and readministering the assessment. 
This method primarily examines the effectiveness of training but can provide information about 
the assessment as well. 

Evaluation of the staff development process and its various components is dealt with at 
length in Section IV, so the detail in thi$ section need not be great. It should be emphasized 
here, however, that a commitment to the examination and re-examination of the effectiveness 
of any staff development process is of critical importance. The information gained as a result 




Establishing Procedures to Determine Assessment Validity 
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of such examination is vital to insuring the success of staff development endeavors. Evaluation 
is never done simply for the sake of collecting data or writing reports. Its function is to provide 
decision-makers with information that can be used responsibly to improve staff performance. 

Review^f Needs Assessment Instruments / 

For the reader's reference, several needs assessment instruments are appended. These are 
rovided not as models, but as examples of instruments currently in use by HCEEP projects, 
y provide an assortment of the types 'discussed in this section. A review ctf these 
instruments may provide useful ideas on developing instruments for use in other programs. 

Appendix A provides an example of an instrument that uses a discrepancy score. TRe 
ipstrument is completed independently by both the staff member andyhis or her supervisor. A 
comparisons made of the two assessments and consensus is reached by the two parties on the 
priority of identified needs and on the methods to be used to meet those needs. Thys instrument 
is administered at several intervals throughout the school year*. 

Appendices B and C~are observation instruments used with project volunteers and teachers 
respectively. Observers are trained in the use of the instruments and inter -rater reliability is 
obtained. Both instruments contain checklists where the observer marks whether or not an. 
activity occurred. "They also require the recording of specific data that provide information 
about the quantity and type of various interactions during the specified time period. These 
observation forms are used both when initially training a. person for the specific role and on a 
periodic basis after training to insure the maintenance of skills. 

Appendix D is an example of an instrument that provides general and specific checklists 
as well as open-ended Responses. The categories used in the instrument serve to structure and 
focus responses in specific areas. The instrument was designed to be self -administered. 
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/ section m * 

DESIGNING AND IMPLEMENTING STAFF DEVELOPMENT ACTIVITIES 

Upon the completion of the needs assessment process, it is assumed that through the use 
of various instruments, observations and personal interviews, staff needs have_been identified. 
The program planner is now ready to design and implement the staff development program. 

Developing Training Objectives ^ 

A number of staff development f program planners proceed direct?y from the needs 
assessment phase to designing staff development activities. Nevertheless, while_planners should 
initiate staff development activities soon after identifying meeds, five important steps must be 
taken before designing these activities appropriately. These steps are essential to insure that 
staff development objectives correspond to the planned activities. These steps are: 

4 

- Clarification of each identified need 

- Identification of the learning domain addressed 

- Definition of the competency required _ * 

- Designation of specific training objectives 

- Establishing priorities ior training 

Clarification of Need. Training is only one of a number of pofential solutions to staff needs/ 
Mager and Pipe (1970) emphasize the importance of carefully apalyzing identified discrepancies 
prior to developing training or inservice programs in order to assess whether training is called 
for. Training is appropriate if individuals have never mastered the skill in question. A number 
f of reasons other than lack of training exist for the inability to perform particular tasks. Some 
of these includes lack ol opporturfSty to practice * skill, -lack o^-motivation or rewarding- 
consequences for performing the skill, unidentified obstacles to performance. Before deter- 
mining that training is the appropriate solution to an apparent need, staff development planners 
must carefully analyze-each need. 

Identification of Learning Domain. Learning can occur in three primary domains: cognitive, 
motoric and affective (see Note 1), In any staff development program, it is expected lhat 
learning will occur iin one of these three domains. Cognitive learning is that which results in 
change in knowledge. Motoric learning produces a change in technical or interpersonal skills. 
Affective learning refers to an attitudinal change. When a staff development need has been 
identified, it is necessary to determine in which learning domain the change needs' to occur. 
The staff development activities required to produce change in each of the three domains differ 
widely; therefore, the donjain must be identified prior to the design of activities. When it has 
been determined that the intended change will be primlrlfy a skill, a level* of knowledge or an 
attitude, it is necessary to define the required competency. 

Defining the Necessary Competency. This step involves translating the identified need into a 
behavioral objective. When this step is completed, there will exist a specific competency, 
written, in behavioral terms, that not only clearly defines the skill, knowledge or attitude 
needed, but also specifies the degree of required competency. This objective will provide the 
focus for the ensuirig 7 stj&ff development activities and the means for evaluating the e|fective- 
ness of staff development endeavors. The literature has indicated that success in' staff 
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development programs "tends to increase as the objective of the program is increasingly more 
precisely specified" (Nicholsen <5c 3oyce, 1976, p. 21). 

Designing Specific Training Objectives. In cases where the competency is broad, although 
stated in prpcise behavioral terms, it may be necessary to break tfie objective into smaller 
units. Task analysis is the process used here. The objectives are reduced to a set of smaller f 
objectives (which may or may not be sequential), the sum of which encompasses the original 
ones. The purpose of reducing the original objective to a set $f smaller objectives is to assist 
the staff development planner in selecting appropriate activities to meet the objectives. Wh£n 
a primary Objective has a number of secondary objectives that Jpad to the attainment of the 
whole, a single activity will seldom suffice. Each secondary objective may require a different 
type of activity. Translating statements of need into definitive training objectives is critical to 

^ the success of a staff development program. Without these objectives, "staff development 
tends to lack necessary substance and merely focuses on delivery and means" (Miller 4c Verduin, 
1979, p. 65). The clarity of the objectives enhances the quality of the decision-making involved 
in devising specific staff development activities. - f 

When the staff development objectives have been_clearly stated, one final step remains 
before selecting or designing training activities; the objectives need to be arranged in order gf 

# priority. * { ; 

Establishing Priorities. *Time, money and personnel resources are seldom unlimited, therefore, 
to conduct a staff development program and insure maximum impact, consideration needs to be 
given to what is most .needed, by whom and when. The prioritizing of training objectives is 
. based on project goals and objectives, administrative preference, the preference of individual 
staff members and the chronological and sequential nature of many tasks in any project. 
Several examples may clarify the process of priority ranking. . * \ 
If staff memBers express a need for training in the use of a number of different child / 
assessment .instruments, but the program administrator has decided that only two instruments 
will be used , training in the use o f ot her instruments becomes a r^uch lower priority, lf_need 
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for training is indicated in -interpreting assessment information and developing individual 
educational programs, the former would be of higher priority since the ability to interpret is a 
prerequisite to the development of an IEP. If training is needed in preparing budgets, and the 
budgets are done in the spring, steps must be taken to insure that the graining will occur just 
prior to the development of budgets, not six months earlier or two weeks later. 

The following example will illustrate the entire process. 

A project staff tta^dentified needs in the areas of collecting data on a regular 
basis to show behavioral change in children and in conducting periodic visits to the 
child's home. * 

1. Clarification of need. t After informally interviewing the staff, it was 
discovered that the problem with periodic hdme visitation was not a lack of 
training but a lack of time for scheduling* This was turned over to the project 
administrator for resolution. Data collection, on . the k other hand, was 
identified as a training need because the staff simply did not know^ how to 
collect appropriate data. 
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2# / Identification of the le arning domain It was determined that this need , 
- involved a specific skill and thus fell within the motoric domain. ' 1 

* ' 3 - Defining the necessary competency . A goal of this project was to teach 

. ^ - children to exhibit social behaviors that are appropriate in a regular preschool 

P, rogr ^ m * In order t0 work toward this goal, teachers needed to be able to 
^identify inappropriate behaviors, teach appropriate behaviors and measure the 
children's progress. ' 

V_ ( . T ne competency required in the area of measurement was to demonstrate 

the ability to collect weekly data on the social behavior programs that have 
been developed for each child, using the method that is appropriate to each 
^ ''specific behavior. *"^S 

. Designing% pecific training objectives . Because the competency objective 

irtvolved_5everal methods of data collection, it was necessary to write a 
specific training objective for each method. They were: 

- Teachers wilt demonstrate the ability to collect frequency data on an * 
ongoing-basis for behaviors that are discrete units occurring less than 20 
times a day. - 

\ Teachers will demonstrate the ability to collect frequency data using a time 
T* \ sampling technique for behaviors that "are discret'e units and occur more, 
s , than 20 times a, day." 
i 



- Teachers will demonstrate the ability to collect duration data for those 
behaviors that areafl&yiisd-ete units and occur fop long per - lods of time> 

5 ' Establishing priorities.. Behavior management was a centraTelemeht of the 
program's intervention model. Because the collection of data was seen as 
integral to the successful functioning of the model, this heed was given a 
top priority. * 

Selecting Appropriate Activities. 

When the five preliminary steps have been completed, the process of planning activities 
may begin. It is important during this process to consider the followjDg4_^the learnerr^h€ 
availability of resources and matching activities to the intende/routcomebTThe staff 
development program. / 

The Learner. Every staff member will enlec the staff developme/it program with a different 
set of needs, expectations, experiences, attitudes and learning styles, but training sessions and 
workshops continue to be conducted for large, diverse audiences. If V majority of staff indicate 
a need in a specific area; training is often conducted for the entire 'staff .^Wieck (1979) states 
that "Diverse audiences ruin even the best training sessions because presenters must aim the 
training at the middle levels of the group" (p. 7). When selecting methods for stafTdevelopment 
it is important to realize that a single delivery mode cannot possibly produce identical changes 
for all of the participants. 

The literature on adult learning includes research, no't only aBput diversity, but about 
commonalities as welh The staff development planner needs, at a minimum, cursory exposure 
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to this literature if staff development systems are to meet the needs of adults. Knowles (1978) , 
makes five assumption^ about the commonalities of adult learners: 1) Adults are motivated to 
learn fpom experiential cues; 2) Adult orientation to learning is Jife-cenffered; 3) Adtilts learn * 
best through experiential modes; k) Adults need to be self-directing; 5) Individual differences 
increase with ag^(p. 31). Hickey (See Note 1) has outlined characteristics of adult learning 
that additionally emphasize adult individuality: the importances of experience the nefed for 
active learner involvement and the importance of basing training on actual need. In addition, 
Hickey addresses the relationship of attitudinal changes to adult learning propensities, 
proposing a direct correlatibn between the manner of presenting educational materials and the 
' implications for the learning potential of the adult learner. 

The need for designing activities that,meet individual needs as well as the needs of the 
organization is widely accept ed* (Nicholson & 3oyce, 1976). Although this is decidedly difficult 
given th£ fiscal and time constraints of most programs, cje#ly_defined_ objectives and creative 
instructional activities can overcome this difficulty. By specifically delineating needs and 
involving \the staff in the planning of, staff development activities, it is possible to provide 
learners with a sense of ownership .towards the education pro£gss, and simultaneously, to 
acknowledge the obvious limitations of personalized training for each staff member. 

Availability of Resources. Staff development planners nedd to identify all available resources 
prior to implementing activities. Resources that need to be considered include time, money, 
space, materials and personnel. Accurate, complete, identification and careful consideration of 
all resources cap result in increased effectiveness of any staff development prograrrf. 

The timing and location of staff development activities should be gearecf to the individuals 
involved. Vmile weekends and after-work hours are>iempting to planners, thes£ time periods 
are not usually favored by the members of a project stiff. Release time during regular working * 
Hours can often be arranged by using substitutes or personnel who are not participating in the 
staff development activity. The location for staff development activities should be con venient 
-4or- participants, and the space sfjou# be appropriate for the sche^ufeU activity. For example, 
participants may best observe and practice intervention techniques in an actual class^om, 
while viewing fi^ns or videotaped programs requires comfortable seating and an area free from 
* distractions. * t w ^ 

Typically, money for staff development activities is very limited. To gain the most from # 
limited resources, the staff development planner will have to Veigh carefully the desired 
&Mtcome against the proposed method of achieving the staff development objective. In 
addition, the staff development planner should explore possibilities for collaborative efforts^ 
with other area PfQgi^ms. It may be possible to jointly sponsor an activity or to arrange an 
agreement wherlbystafS^nembers from one^project are permittee/ to attend appropriate 
activities sponsored by another agency. 

\ The identification of material ajid personnel resources' is frequently overlooked in staff 
development planning. Materials of little or no cost* can be found in public and university 
lrqraries, community agencies serving similar populations and on the shelves of project staff 
members. Since a wealth of materials currently exists,' it is cost-effective to spend time 
locating them prior to initiating a costly ancf time-consuming effort to develop appropriate 
ials. The same is true for personnel resources; efforts to locate trainers should begin 
he identification of skills and expertise within a project's staff. A teacher skilled in test 
inistration may be used to train other teachers. This is certainly less expensive and may be 
morle appropriate than bringing in a consultant or sending staff to an outside training program. 

I Devoting sufficient time and energy to the identification of available resources can 
significantly increase the available options for staff development activities. Increasing the 
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available options will result in a greater potential for success as well as a greater opportunity 
for individualizing programs. • 

Matching Activities to the Intended Outcome. Staff development' activities are intended to 
effect changes jn skill, knowledge or .attitude of individual participants.' For an activity -to 
produce the desired outcome, it must, be well matched *ith the objective. Different training 
needs will require different types of activities. Increasing an individual's knowledge in a given 
area-can be accomplished by lectures, selected reading, programmed instruction and observa- 
tion. Changes in skill would suggest an opportunity for the individual to practice the skill. ■ To 
illustrate the match between objective and .activity, several activities and their likely outcomes 
will be described. « ' 

' ' , . — J ecture ® r selected reading on behavior modification techniques will likely result "in 
increased knowledge^oi-Tlrose techniques. It is possible that increased knowledge "of the 
techniques may change attitudes about the effectiveness or ineffectiveness of their use. -It is 
/ far J. e * s llkely that . these activities will result in changes in an individual's skill at using behavior 
"modification techniques. 

Videotapes or live demonstrations of. behavior modification techniques can increase 
knowledge if they are accompanied by explanation. Observing the techniques in use may be 
more effective at producing attitudinal change than attending a lecture, and there is more 
likelihood that skill level will change. 

Demonstrating behavior modification techniques, having participants practice the skill 
and then critiquing their efforts, is^possibly the most* effective means of producing change in 
an individual's skill. This activity may also result in attitudinal change and increased!! 
.knowledge, but it may be more involved and time-consuming than is necessary for that result/ 

Careful .consideration of the desired outcome as well as knowledge of individual learning 
styles and preferences will increase the likelihood of selecting" appropriate activities. 

Types of Staff Development Activities 

• The list of possible activities for meeting staff development objectives is limited only by * 
the scope of one's imagination. Rather than attempt the impossible task of listing infinite types 
of staff development activities, a number will be reviewed to provide the reader with examples 
t of the diversity in these activities. * 

Professional Reading. The provision of readily available written materials can be 
economical in terms pi bo.th time arid money.- If staff development is aTmed at a^hange in 
knowledge, benefit can be derived from the development of a good professional libraf y. Staff 
members may more readily select this^a<;tivity if some direction is provided regarding the 
^ availability of materials. . / & & 

Staff-to^staff Instruction. Members of a staff who are skilled in a given area may 
provide training to other staff members who need to develop skills in that 'area. The 
arrangements for this type of activity are extremely flexible. Training may be provided 
individually or in small groups, in the classroom or an office, during the school day or over 
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, Staff Exchanges or Visits. Exchanges may be made with other programs to provide 
, needed staff development. This can take the form of directed observation, the exchange of 

information or direct instruction. This activity lends itself to a- reciprocal agreement. 
. Programmed Instruction. These teacher training packages are self -administered and the 
individual may set his or her own working pace. Programs may be purchased commercially or 
be project -developed. The format may be written, audiovisual or computerize^. 
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Consultation . Calling in an expert consultant can be an effective activity ^mode. 
Nicholson and Joyce (1976) indicate that this mode is most productive if it is decentralized and 
individualized; that is; if it is requested by the teacher, meets the teacher's expressed need and 
occurs at the school elding school hours. 

Workshop . A workshop generally consists^ of a number of staff people working in 
conjunction with a 'leader as resource person to solv* a specific problem or achieve a specific 
goal (e.g., to develop assessment procedures). The workshop can be a very potent activity mode 
if the purpose is well-defined, the participants accept this strategy, and a good match has be^n 
made among participants,*resource personnel and intent (content). / 

Coursework, Lectures and Conferences . These have been recognized as appropriate staff 
development activities; their major drawback is lack of. control over content. If a class, lecture 
or conference does not relate directly tp the defined needs of individuals arid the organization, 
much of the value as a staff development activity is lost. 

. Attributes of Successful Staff Development Activities 

Nicholson and* Joyce (1976> 5? list a number of attributes which pertain to implementing the 
appropriate activity for an identified audience. These include: • * 

1. Individualized prpgrams are more likely to accomplish jheji^objectives than 
programs that ha£ the same activities for all participants* Individualization, 
furthermore, shJIFd be understood not to <t>e limited to variations merely in 
pace and sequence of materials. 

2. Programs in which teachers t§ke some active role (e.g., generating a set of 
^ * instructional materials) are mcfi&likely to be successful than those in wlnich 

teachers are limited to a passive or receptive role. 

.3. Programs based on a demonstration of materials or technique, combined with a 
supervised trial and followed by some form of feedback are more likely to be 
successful than those in which information or instructions are learned and 
stored for future application. 

4> Programs in which teachers provide mutual assistance are more likely to be 
successful than those in which teachers work entirely on their own. 

5. Programs occurring as part of an overall staff developmenj plan or general 
effort of the school are more likely to be successful than one-shot efforts. 

6. Programs of emergent design, in which teachers themselves choose at least 
some of the goals and activities, are more likely to be successful than 
programs whicjh are entirely preplanned. 

7. Programs which are self-initiated and self-designed tend to have a high rate 

of success, (p. i% 

Inclusions of as many of these attributes as possible in any activity may increase the 
likelihood of that activity's success. 
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SECTION IV 
EVALUATION OF STAFF DEVELOPMENT 



The" preceeding sections have discussed the development of objectives for staff develop-! 
merit programs and described activities to meet those objectives. The final component of a 
staff development, program is evaluation. Once' needs have been carefully analyzed and 
prioritized, and appropriate training activities have been selected and carried out, the process 
ot evaluation Begins. Its purposeTs to measure whether staff development objectives have been 
met. i * ' 



'q ♦ , e p ^ ima fy aud »enee for evaluation data are the project adminstrator and staff members. 
But evaluation data from a staff development program may be useful to the project officers at 
Special Education Programs (SEP) (formerly the Office of Special Education) and other agencies 
■er-projects interested in adapting the HCEEP model staff development procedure. To meet the 
neette of all audiences, five levels of evaluation should be considered. They are: 

n"^ 1 " 6 d e g ree o* satisfaction which" the staff member (trainee) has in the training 
received. ' • 

2. The degree of knowledge, skills or attitude change acquired by the staff member 
, during training. * ' 

4 h " ? ' ' 

The degree to which the staff member in hi^or her natural setting applies the skill 
or knowledge acquired. ' ^ \ 



le 

5. The degree of maintenance of stajff skill's over time. 



4. 'the amount of child change achieved as a result of implementing the procedures 
learned by the staff. 



... L Th ,^ Se five levels constitu te the evaluation plan for staff development activities. Each 
will be discussed<below in greater detail. ^ 7 ^ 

Level One: Evaluation of trainee satisfaction « 

The 'kind of evaluation most often found in staff development training is trainee 
satisfaction. Usually, satisfaction da*a is collected by using a questionnaire or survey that asks 
the trainee: Are you pleased with the* type of- training that you received? Was the subject 
matter appropriate?" Was it well presented? Did it satisfy some of your needs? A number of 
examples of such questionnaires are available. Alvir (1976) developed evaluation packets for 
,teacher inservice workshops via participant evaluation and observer evaluation. Appendix E is " 
an example. The .HCEEP 'Orientation Conference in which all new project directors participate 
in the fate summer or earlW fall has anevattuation, system which also focuses primarily on 
participant (trainee) saturation (Appendix F). 

», Ev jj^gfc ion of trairel satisfaction is important because it concentrates on the trainee's- 
perceptf^W whether -of not hi^or b£r needs are being met. The whole process of 'the staff 
developmen^rogram started \with> statement of needs-those of the staff members and the 
administrate this kind of evaluation focuses on those need^ Similar kinds of questionnaires 

* »*,-•**, 

' • •• • • r: * ■ . - • 




can be givehto an administrator to determine whether or not he or she perceives that the 
training" is meeting staff needs. 

Level Two: JEKe Acquisition of Skills, Knowledge or Attitude Change During Training 

The second level of evaluation is a determination of whether the staff person acquires 
skills, knowledge or attitude Change during staff development training. A number of techniques 
are possible here, though pre and posttest measures are frequently used. For instance, at ap 
ihservice workshop on language programs for mentally retarded preschoolers, the workshop 
coordinator may give a pretest on the knowledge of the characteristics of different language 
programs prior to an inservice workshop for teachers. The coordinator will then give the same 
test at the conclusion of that workshop to determine ^ether^the trainees have acquired 
knowledge about the content of the various programs. * * ^ 

OthePT?inds of inservice training place the trainee in a performance situation where he or 
she -must teach a child 0 a certain skill using a specified methodology. Through a system of 
feedback to the trainee as the teaching occurs, the trainee's performance changes during the 
workshop. Observational data are taken during the first performance of the trainee and then 
during later performances to demonstrate change in the performance which resulted from the 
training* 

The samejdnd of observations or data can be used for on-the-job training where a 
supervisor and the staff person agree that a certain interaction skill needs to be acquired by the 
staff member. The supervisor takes some baseline data on the performance of the staff person, 
sKSres that baseline data with the staff person and then instructs that staff person through a 
process of feedback on how to change his or her behavicfr. After .subsequent measurements are 
taken, the evaluation of staff performance is achieved. C 

•In this second level of evaluation, some kind of pre and post measurers necessary to 
demonstrate that learning occurred during the inservice training. A postmeAure alone is a 
weaker form of evaluation, but it may suffice if no pretest can be taken. Although a 
■ post measure can demonstrate that a person does have specified skills at the end of an inservice 
'training session, a postmeasure alone does not demonstrate that the person acquired these skills 
or knowledges as a result of the training. While the workshop object iveiynay appear to have 
been met, there is no clear evidence that the workshop effected those^objectives. Causal 
relationships cannot be demonstrated without both pre and postmeasureS. 

Level Three: Application of Learned Skills and Knowledge ^ 

The third level of staff development evaluation focuses on the implementation of the 
acquired skills in the staff person's natural environment. While there is no easy way to measure 
this skill implementation, thfe surest way is direct observation of the trainee on the job. This 
can easily b^ demonstrated in those cases where the supervisor is providing th6 immediate 
inservice training to the staff member. In the case where 'the supervisor took a pretest measure 
ojy initially observed the* staff person, provided' Inservice training and then saw. that the staff 
person had acquired the skills, the supervisor now,<need only make periodic observations to 
determine that the' staff person is Using those skills on a routine basis in the work environment. 
In lieu of the supervisor providing the observation, Project KIDS,' for example, provides a 
self-assessment inventory for their staff. The directions for conducting the self -assessment 
and an example oi ope of the 20, competency ar^as in the inventory are shown in-Appendix G. 



In those instances where a staff person is trained in another setting and has demonstrated 
during the training that he or she acquired the specified skills, the evaluation of whether those 
skills are implemented in the trainee's work' environment is more complex. Usually it requires 
the trainer to visit the work environment, make observations of the trainee and determine, 
through those observations, whether the trainee is implementing the training and performing at 

•a specified criterion level. This kind of evaluation is expensive, time-consuming and very 
seldom conducted as a result of a staff development workshop. Occasionally, a supervisor and 
the trainee may attend the same workshop,«enabling the supervisor to observe the staff person's 
performance v and determine whether he or she is applying the newly learned skills. The expense 
and time involved, however, often prohibits such joint attendance. 

Many use either phone or mail questionnaires to determine if trainees implement a 
specific practice in their work environment after a training session. This type of questionnaire, 

•however, is at best an unreliable measure. One can assume that trainees who respond will 
inevitably be those who have implemented the measures, although a small number of those who 
are discontent with the training will indicate that they did not utilize the new skills. Those who 
do not respond probably are not implementing procedures. Therefore, the data that are 
gathered through a questionnaire are generally skewed to the positive side, and its reliability is 
questionable. 

An example of a. follow-up to inservice training of teachers is contained in Appendix H; a 
sample of objectives that are used by an early childhood Outreach Project to train other 
teachers in the project's techniques. Notice th&t-objectives and criterion levels 'have been ) 
specified. This data is gathered by observation in the trainee's home environment. 

Level Four: Effects on Children 

The fourth level of evaluation focuses on the effects of the staff development training on 
the children served. Child-change data is the most difficult and expensive to acquire. It can be 
acquired locally at one site by comparing the pre and posttest scores of children prior to staff 
training with those following staff training. Comparison of this data should indicate child 
change. The problem that most projects have with this data is, of course, the small number of 
children involved. This factor should not dissuade the project from makin'g the attempt to 
gather this data as child^hange data is perhaps the most powerful demonstration of the 
effectiveness of an inservice training program for staff development. 

The literature in the behavior management area contains more examples of child-change 
data than v that in any other curricular area. For instance, Gladstone and Sherman (1975) 
demonstrated that retarded children acquired skills after high school trainees, who were their 
volunteer teachers, were taught certain teaching techniques. McKeown, Adams and Forchad 
(1975) demonstrated a reduction in disruptive behavior in classrooms, where teachers were 
taught behavior modification techniques. Burg, Reid and Lattimore (1979) increased 
interactions "between direct care staff and profoundly retarded persons in a state residential 
facility as a result of instruction and monitoring by supervisors. Examples of other types of 
training generally focus on systems such as the Englem^n DISTAR system which has gathered 
data systematically through their follow-through program to demonstrate that their procedures 
produced change in children. Another example is the kind of data which was validated at the 
Joint Dissemination and Review Panel for the Inservice Training Project of Teaching Research 
(a division qf Oregon State System of Higher Education). These data demonstrated that 
children who were trained in classrooms of teachers trained by Teaching Research made 
significantly higher gains after training than before (Fredericks, Baldwin, Moore, Templeman <5c 
Anderson, 1980). 
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Level Five: The Maintenance of Staff Skills 

The fifth level of evaluation pertains to the maintenance of learned skills, attitudes or 
knowledge' over time. Griffin (1978) pmph^sized the need for this kind of ongoing evaluation. It 
is important for two reasons: Staff development implies growth, and this in turn requires the 
continual building and maintaining of a staff ^ember's personal development* In addition, an 
HCEEP project, because it is a model, is es£ecte<J to be copied by others. Thus, there is a 
requirement that once the model is ready %6 be replicated, the staff are functioning at a high 
level of performance, thereby presenting^ highly functioning model. Ongoing evaluation must 
include some type of observation syst^fh* ^administered either by the staff or by supervisory 
, personnel. Griffin indicates the possible need for many 4 people being involved in this kind of 
evaluation. 



Occasionally, aspects of an ongoing observation system can be self-administered, but even 
self-administered instruments should be monitored and checked by supervisors. An example of 
the^self-monitoring technique is the instance where a staff requirement is that a preschool 
^plassroom teacher complete §p% of the individual programs scheduled for each child on a daily 
" basis. The teacher can -monitor his or her own performance by noting the number of programs 
required and the number administered, computing the percentage of completed programs, and 
thereby checking on his or her own job performance. Another example is the nurse in an 
intensive care unit who fjas been trained to interact with a, child in a certain way and on a 
certain daily frequency. The nurse can self- monitor the frequency and whether or not he or she 
has accomplished the particular requirements of the job. 

The quality of the interaction over time between the nurse and the child, however, may be 
better monitored by a tljird-party observer. Quality of interaction is one of the most important 
criteria for assessing' the performance of staff who must interact with children. There are 
certain ways to hold infants, certain ways to cue children to perform certain tasks and certain 
techniques for responding to children. Each of these behaviors can be observed by ^supervisor 
who then can conclude whether the staff member is achieving the specified criterion for 
performing the particular behavior over an extended time period. 

Evaluation of the maintenance of skills must be as structured as other kinds of evaluation. 
For instance, one HCEEP project requires that the teacher in a classroom formally observe the 
teaching assistant once" every two weeks to examine the way in which he or she is interacting 
with the children in a group situation. There are certain requirements and criterion levels for 
cueing, rotating attention* and providing feedback to the children. If the teaching assistant is 
not meeting these requirements at the appropriate levels, the teacher must immediately 
intentefte and administer on-the-spot inservice training, followed by more frequent observa- 
tions. If the teaching assistant is meeting the criterion levels of performance, the teacher 
should give him or her positive feedback* 

Houts and Scott .(1973) eftiphasize the importance pi an. ongoing evaluation system which 
focuses on the good performance, not the deficits of the "staff. Such an approach to evaluation 
will engender staff support of the system. A general format for an evaluation system 'focusing 
on the maintenance of staff performance is summarized in the following six steps: 1) precise 
definition of staff performance requirements, 2) an observation of instruction, 3) a schedule of 
observations, criterion levels' of performance, 5) a plan for remediation if performance is 
below criterion levels, 6) emphasis on the positive aspects of performance. 
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APPENDIX A 
Project TRACE ^ 



E 

Staff Development CheCgllp. 

Please give consideration to each skill listed. In the column marked "R, ,p please indicate 
the degree of competence you feel is required of that skill for your position. Rank from 
•0 to 5 (with 0 being none to 5 being considerable). In the column marked "A," please 
indicate the degree of competence you feel you have achieved in that area (also from 0 to 
5). Column D will reflect the difference between the required and achieved columns. 
Supervisors Will also complete one form for each staff member, and together the 
priorities will be determined. - 

R - Required skill for position 

A - Achieved level -of performance by individual^ 

D - Discrepancy between R and A— or further development needech- 

*■ ^_ ^ 

Data Collection r a ' D 

Project TRACE Staff shainl^ / 

1. Identify staff target behavipfs and skills 

2. Select appropriate methods for collection of data ~Z~ 

(i.e., standardized t^sts, informal tests, observation, 

frequency, time sample) 

3. Collect data in an organized manner " \ * 

4. Interpret results of data to parents and staff 



IEP 

Project TRACE Staff shall: 

1. Demonstrate knowledge of P.L..?4-I42 and pertinent 
s district procedures pertaining to IEP development J. 
/2. Establish student's present level of functioning 

3. Write measurable long-term goals for student 

4. Write measurable short-term objectives for student 

5. # Explain in clear and concise terms the child's 

progress using data for support , 

6. Encourage involvement of parents in IEP process 

Daily Lesson Plan * 
Project TRACE Staff shall: 

1. Plan daily activities for children 

2. Select units of study, activities and materials 
appropriate to child's needs 

3, Exhibit familiarity with and ability to use instructional 
materials 

4, Demonstrate ability to individualize materials and . 
activities * 
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APPENDIX A (Continued) 



5. Mainstream students and coordinate activities^ith 



regular classes J 

6. Coordinate activities with special services 

7. Use a variety of grouping methods 

8. — Prepare plans for substitute teacher 

Behavior Management 
Project TRACE Staff shall: 

i. Exhibit knowledge of and proficiency in the use of the 
following behavior management techniques: 



a* 


Rewards 


b. 


Punishment/time out 


c. 


' Reinforcement schedules 


d. 


Group techniques 


e. 


Consistency 


f. 


Shaping/chaining 


g- 


Premack principle 


h. 


Modeling 


i. 


Charting behaviors 


Target specific behaviors 



3. - Demonstrate ability at task analysis 

4. Select appropriate management techniques 

5. Implement appropriate behavior management techniques 

6. Train others in the use of behavior management techniques 



Areas of Exceptionality 
Project TRACE Staff shall: 

i. Demonstrate knowledge- of characteristics of children with 
these handicapping conditions and appropriate teaching 
methods: 

a. Educable mentally handicapped 
4 b. Emotionally disturbed 

c. Learning disabled f 

d. Vision impaired 

e. Hearing impaired 

f . Speech and language impaired* 

g. Physically handicapped 



Assessment 

Project TRACE Staff will demonstrate ability to: 

1. Administer standardized and informal tests 

2. Interpret results of gathered data / 

3. Report assessment information tcxparents and staff* 
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APPENDIX^ (Continued) 
Relationships with Parents 

Project TRACE Staff shall: RAD 

1. Demonstrate knowledge of initial screening procedures 

2. Inform parents of purpose of IEP . " 

3. Demonstrate knowledge of parents 1 rights and 

responsibilities 

4. Know student orientation procedures (i.e.„registration, 

necessary medical records, bussing, etc.) 

5. Effectively involve parents in classroom observations 

and participation ^ 

6. Communicate effectively with parents through: 
|J~a. Phone conversations 

b. Written correspondence 

c. Newsletters " 

7. Plan home visits on regularly scheduled basis 

8. Prepare fotquarterly conference with parents ~~ 

% * — — >■ ■ 1 ■ 

Child Development 4 % 

Project TRACE Staff shall: 

1. > ^Demonstrate knowledge of appropriate skill levels in the 
* following developmental areas: 

a. Self-help 

b. Motor 4 ' , 

* 1. Gross motor development $ 

2* Fine motor development ' ■ 

c. Processing 

!• Visual processing 

2. Auditory processing . ~ 

d. Social and emotional development - / 

e. Language development 7 " 1 • 

f. Readiness/academic * 

* . , _____ 

Child Find 

Project TRACE Staff shall: 

1. Demonstrate ability to administer screening instruments 

2. Evaluate and interpret result of screening procedures 



ERIC 



Note: Developed by Transitional Resource Addressing Children's^Education (Project 
TRACE), West Chicago, Illinois. Reprinted by permission. t 
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APPENDIX B 
Volunteer Observation Form 



Volunteer: 
Student; j_ 
Observer: 
Time: 



to 



I. 
2. 
3. 



Dote:' 

Program: 

Cue (VerbaTJ: 
Cue (Non-VerboU? 



Volunteer has correct materials 

Materials, volunteer and data sheet in best position for presentation 
Student in correct position 



Correction Procedure: 
Criterion: 

Behavior (Phase/Step): 
Reinforcers: 



YES 



NO 




CUES 



Appropriate 



No 
Cue 



Weak 



Change 
Wording 



Repeated 



CONSEQUENCES 



Positive Reinforcers 



Appro- 
priate 



No 

Rein- 
forcer 



Fall 
to Pair 



Weak 



De- 
layed 
(2 sec) 



In- 
appro- 
priate 



Appro- 
priate 



Correcfion Procedures & Punishers 



No Cor- 
rection/ 
Punisher 



De 
layed 



Inap- 
prop 



DATA 



Recorded 



Cor- 
rect 



\ndor- 
rect 



Y 



Cues: 

Appropriate 
Total 



equals 
% 



Consequences: 

Appropriate 
Total 



b equals 
% 



Data: 

Correct 
Totai 



equals 



Positive Feedback: 



Recommendations for Improvement: 



APPENDIX C 

^ Teacher dbservation Form 

10 Minute Observation 



Teacher: 



Observer: 
» 



Date, Time: 





30 Second Time Sample 


Continuous Time Sample 


i 

Aide 

Volun- 
teer 

Child 

Total 




Appr 


opnate 


Inappropriate 


Total 


Delivery of Consequences 


Inter- 
acting 

— ■ — 


Modeling 


Checking on or 
Observing 


Administra- 
tion, Sched- 
uling, etc. 


Not Attend- 
ing to Pri- 
ority Sit. 


Otter 

(□st) 


Appropriate 


Inappropriate 


W/Form 


W/O Form 


Positive 


Negative 


Positive 


Negative 














* 




































BEH/Test 





































1. 

2. 
3, 

4, 
5. 
6. 

8. 



9. 
10. 



Ail programs scheduled to be run 
Volunteers kept on schedule 
Checks clipboards at least once per "" 
morning 

Adjusts schedule when necessary 

Available and eager to assist staff ~~ 

Remains composed and pleasant 

Circulating/Rotating attention 

Assists aide when table becomes 

crowded or behavior problems are out • 

of control 

Conducts one-to-one programs if 
time (Sermits 

Obscwes no more than one program 

unle* there are problems the ' 

teacner is assisting with. 



Yes No Feedback to Teacher: 
1. 



2. 



Time Spent Appropriately 
Criterion 80% 

// Appropriate Marks, 

Total Marks 
Score 56 

Appropriate Task Areas Completed 
Criterion 6 Areas 

//.Areas Completed 

// Areas- Available 
Score % 



3* Teachers Checklist 
Criterion 80% 

// Areas Completed 
, Total Areas 
Score % 
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Name ' 

Discipline ____ 

Site 

Date 

• »\ 

General Needs Assessment. 

Directions: Please check 5 ( ) the three areas Which you feel are your highest priorities for 
training in the area of the severely handicapped. 

1 • Initial assessment procedures f or/pupils/clients 

2 » Establishing instructional goals and short-term objectives 

3. Planning pupil/client programs 

/ *• Selection of program materials 
a I 5. Selection of program strategies ^ 
^ 6. -Use of ongoing measurement procedures 

7 * Overall evaluations of pupil/client progress (e.g., quarterly, annual) 

How to work cooperatively with other educational professionals 

9. Management of professional time 

10. Inservice presentations from other professionals (e.g., OT, PT, speech thera- 
pist, social worker, nurse, psychologist, educator) 
1 1- Identifying and locating resources 

12. Training others (pptraprofessionals, parents, professionals) 

13. Scheduling, coordinating and managing resources 

1*. Designing, managing and administering special programs (e.g., infant, voca- 
tional, parent training) 

15. Legal rights of the handicapped • r 

16. Other; specify: ^ 

17. Other; specify: , 

Specific Needs Assessment 

Directions: Please check ( ) the two areas, which you feel are your highest prio'rity areas 
for training under eac^of the following categories. Check only two in each category. ' 

1. Initial Assessment Procedures for Pupils/Clients 

1.1 Assessment instruments 

1 »2 Assessment techniques j 

; 1*3 Assessment rationale 

^ I A Other; specify: 

2. Establishing Instructional Goals and Short-Term Objectives 

* 2.1 Appropriateness 

2.2 Rationale 

. 2.3 Format (how to) 
2.* Prioritizing 

♦ 2*5 Other; specify: ■ 
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APPENDIX D (Continued) 
Planning Pupil/Client Programs 

' 3. 1 Pinpointing behaviors 

3.2 Task analysis 

3.3 - Program format (how to) 

3.4 Other; specify: 



Selection of Program Materials 



4.1 Identifying available materials 

4.2 Evaluating materials 

4.3 Modifying existing materials 

4.4 % Other; specify: 



Selection of Program Strategies 

5.1 Steps in the learning process 

. 5.2 Determining what strategies are appropriate 

5.3 Behavior management 

5.4 Other; specify: r , 



Use of Ongoing Measurement Procedures 

6.1 Selection of tools and procedures 

6.2 Implementing measurement systems 

, 6.3 Use of measurement information^i.e., to modif)^rogram) 
6.4 Other; specify: 



Overall Evaluations of Pupil/Client Progress /e.g., Quarterly, Annual) 

7*1 Selection of tools and procedures 
7.2 Implementing evaluation (how often) 

7.3 Use of the evaluation information (e.g., iuture programming, grouping 

pupils) 

7.4 Other; specify: _____________ 



How to Work Cooperatively with Other Educational Professionals 

8.1 Communication techniques + 

8.2 Roles and descriptions 

8.3 Implementing a team approach to providing services to pupils 

8.4 Other; specify: ___^_^___ 



Management of Professional Time 

$ 

[ % 1 Prioritizing activities 

9.2 Scheduling priorities 

9.3 Coordinating schedules with other professionals 

9.4 Scheduling classroom/client programs. 

9.5 Other; specify: » 
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APPENDIX D (Continued) , 

from V lht belowr^ 10 " 5 ^ Pr6fessioniUs (List P^sionais by numbers 



107l Assessment 

10.2 Program planning 

10.3 Measurement, evaluation 

10^ Instructional strategy 

10.5 Resources 



1. Teachers/Educators 7. Family Services/Social 

2. * Administrators 4 Workers 

3. Speech Clinicians ~~ 8. Nurses 

J. Physical Therapists 9. Vocational Educators 

5. Occupational Therapists 10. Psychologists 



[ 6. Other; specify: 

Identifying and Locating Resources : 

L 

- 1 1-T Identifying the need for resources. 

11.2 Identifying community resources 

H»3 Selecting appropriate resources 

11.* Other; specify: 



Training Others (Paraprof essionals, Parents, Professionals) 

12.1 Parents and families 

12.2 Volunteers % 

124 Assistant teachers, OTs, etc. 

12.* Organize an inservice (how to) 

12.5 Other; specify: 



Soheduling, Coordinating and Managing Resources v 

*3.1 Use of resource personnel ■iftthe classroom 

13.2 Working in and with the community 

13.3 Public relations 

13.* Parent groups 

13.5 Other; specify? [ ^ 



Designing, Managing and Administering Special Programs 

1^.1 Infant programs t y 

1^.2 Vocational programs " f 

I *«3 Cormriunity living programs ' 

1_ 1 Family training 

■_ U.5 Other; fcpecify: ' 
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» APPENDIX^ (Continued); v . 

15. Uegalllights of the Handicapped « 2 -\ • *.' - 1 

15.1 P.U94-142 

, ._ 15.2 50* " 

15.3 State rules and regulations , % 

' 15.* Otherj specify: , ; 



-fr 



16. Other r Refer to the general needs assessment and specify: 



r 



16.1 
16.2 



17T" Other: Refer .to the general needs agsgssment and specify: 




17.2 




Note: " From Haring, N.G., & Lynch, V. (Eds.),, Handbook for staff tra ining and 
development . Seattle, WAr Experimental Education' Unit, College of Education, Center 
jbr Inseevice Training, University 6f Washington, 1979. (Unpublished manual.) Reprinted 
by permission. 
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APPEJNDI5C E 

PARTICIPANT'S EVALUATION OF INSERVICE TEACHER WORKSHOPS 

Directions : 1, Identify the' workshop and the dates of attendanqe. * 

* * *■ * 

Workshop: _ , * , 

' Dates: ^ \ 

2. Circle YES or NO for each of the following. Comments may be added. 
Questions left blank, undecided or answered with both YES and NO will 
automatically be tabulated as NO unless ^l^ined with a comment. 



•2. 
3. 

4. 

5. 
6. 
7. 

8. 

9. 

10. 

11. 
12. 

13. 



I was made aware of the wqrkshop objectives before I came to 
the workshop. 


1. 


YES 


NO 


The workshop objectives were clearly stated. 


2. 


YES 


NO 


The workshop objectives vtere related to my teaching concerns 
as an occupational educator. \ ; , 

* ^ 


3. 


^YES 


NO 


Most of this workshop centered around material that was 
interesting, challenging ai\d useable. 


% 


YES 


NO' 


The pilose and objectives of this workshop made sense to me. 


5. 


YES 


NO 


The workshop objectives were met to a high degree. < * 


6. 


YES 


N$t 


This workshop should be held again with the &jne objectives \ 
for those of my colleagues who were unable to attend. , ■ > 


7. 


YES 


NO 


This workshop should be held again for the same participants 
on a more advanced level. « 


8. 


YES 


NO 


This workshop hacf some components whiph were unique or , 
innovative. 


9,. 


YES 


NO 


Most of the scheduled workshop activities made good use of 
the time available. 


10. 


YES 


NO 


**> • . 

Most presentations were well organized. 


11. 


YES 


NO 


Most workshop personnel (speakers, presenters, and resource • 
persons) provided the kind of information, expertise, f 
creativity and communication skills expected by me as a - 
participant. 


12. 


YES 


NO 

r 


Most sessions offered stimulating or new material. , 


■ 13. 


YES 


NO 



A . „ . ^PPENDlA E (Continued) 

1*. My questions were dealt with satisfactorily. 1*. YES NO 

15. The workshop activities were appropriate for meeting tlte 15. YES NO 
' ' stated objectives. 

16. Instructional resources were appropriate and adequate for 16. YES NO 
' achievement of workshop objectives. 

- 17. There was evidence of good administrative practice in . 17. YES NO 

t leadership and supervision on the part of the workshop 

* * director. ^ 

18. Meeting room facilities were Suitable. * 18. YES NO 

> / 

19. The physical environment was adequate as far as lodging, 19. YES . NO 
lighting, ventilation, parking, cafeteria ahd other such 

things were concerned. * 

20. . This workshop was a successful training experience for me. 20. YES NO 

21. The workshop Content was practical and useful in helping 21. YES NO 
improve classroom instruction. 

) ' * " • ' * 

2?. ' Reasonable progress was made by me individually towards 22. YES NO 

meeting the objectives of the workshop. , - 

23. " * I had a chance to provide feedback to the workshop staff. . 23. YES NO 

24. I had a chance to identify professiortal needs which I 24. YES NO 
previously had ignored. 

25. ^ This workshop had some implications for the way I teach. 25. YES NO 



26. The things I learned at this workshop will h£> the 26. YES 

students I teach this coming-year* ^* ^ 



NO 



27/ Overall, this workshops/as a worthwhile and valuable 27. YES NO 

expewence. 

28. I am able to list specific benefits I received at this 28^ YES NO 

workshop* * - 



j 



Note: From Alvir, H. Three packets with which to evaluate teacher inservice workshops 
via participant evaluation and via observer evaluation. Albany, NY: Bureau of 
Occupational Educational Research, New York State Education Department, (Eric 
Document Reproduction Series No. ED 120 12*.) Reprinted by permission. 
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APPENDIX F ' 

Portion of HCEEP Orientation Conference Questionnaire 

. .» > 

In the following section we want to determine the extent to which the goals of the 
Workshop were accomqlished . "Rate each goal according to the following scale: * 

7 - Fully Accomplished 

5 ; , . 

4 - Partially Accomplished * 



1 - Not Accomplished 



AS" FA NA 



1. To provide information about the historyand * \ f 

purposes -of the Handicapped Children's EarT ' 
* Education Act. 



39 
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5. * y 

2. To provide information about the Handicapp£„ 
3 Children's Early Education Program (HCEEP), 

as currently administered by SEP. 

3. To provide inforftatitfn^about the exponents 
of an educational itiojdefland its development* 
and dissemination. ' I 7 6 5 4 3 2 

4. To provide information on plapptfng, managing 

and evaluating an HCEEP Demonstration project. 7 6 5 4 3 2 

> 

'5. To provide information about federal requirements 

for grants funded under HCEEP. * 7 6 5 4 3 2 

6. To provide information about the Technical 
assistance services available to aflkoewly ' 
.funded HCEEP Demonstration prljects and how 

those services are acquired. I % ' * ' 7 6"5 4 3, 2 

7. To prdvide an opportunity for project directors ^ 

j--. to meet their respective -SEP; project officers. 7 6 5 4 i 2 

8. To provide an opportunity ipr project directors 
to meet other dire&fers and*ta share information 
on topics of common concern* 

4 

Comments on workshop objectives: 



APPENDIX G 



2. 



3. 



Sample of Self -Assessment Inventory from Project KIDS 

Directions 

1. Assess your level of mastery in each competency. 
Review descriptions of suggested activities designed to improve level of 
mastery. » 

Select one activity if your level of mastery is (1), select^jyo activities, if your 
level of mastery is (2), and select three activities if your level of mastery is 

Levels of Mastery . 

1 1* I feel competent in this area. 

2. I can demonstrate minimal skill 'in this area now. 

3. I have little confidence in this area. 

— S - 

Example of Self-Assessment Inventory 



Competency Areas 



Level of 
Mastery 



Suggested Activities 



10,0 Tne early childhood teacher *ill » 
have knowledge of the generai 
counseling techniques to use at 
various stages of parent adjustment. 




10.1 Read case histories and identify adjustment 
stages* , 

10*2 View videotape of parent/professional 
dialog. ^ Identify adjustment stages 
and discuss with specialist* 

10*3 Yiew videotape of parent counseling 

session and critique counseling behavior. 

10.4 Role play teacher /parent conference and 
critique techniques used by teacher. 

10*5 Yiew videotape of Robert Perskcfc discus- 
sion with project KIDS parents. Discuss 
communication skills identified in videotape. 

10.6 ReadKroth, R. L. Communicating With 
Parents of Exceptional Children: Improving 
Parent-Teacher Relationships* Denver:- 
Love Publishing Co., 1975. The focus of 
this paperback book is upon the facilitation 
of effective parent-teacher partnerships'in 
Voviding optimal services for the excep- 
tional child. The book itself is a compila- 
lon of "techniques: to be used by teachers" 

(Sections Mil). 

10.7 Read and discuss: "Psychological Counsel- 
ing with Parents of Retarded Children" by 
Philip Roos in Mental Retardatipn t 
December, 1963 (p. 345-351). " 



Note: From the Staff develo pment package . Project KIDS. Dallas, TX, 1977. Reprinted 
by perrrjission. * 
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APPENDIX H 



Examples of Objectives, Activities and Evaluation of Follow-up 
of an Outreach- Inservice Training Project 



\ 



<8* 



Objectives 



Activities 



Evaluation 



1. Trainee will be able to con- 

. duct prescriptive programs in 
the areas of self-help, motor 
development and language. 

2. The trainee will pinpoint an 
inappropriate behavior 
exhibited by a handicapped 
child, gather baseline on that 
behavior and design a program 
to alter the specified beha- 
vior. 



The trainee will demonstrate 
the ability to manage groups 
of children engaged in free- 
time, or seatwork activities.* 



ERLC 

hnmitfmwmm 



"46 



1.1 Conduct prescriptive programs with a handi- 
capped child in an individual instructional 
setting in the curricular areas of self-help, 
motor development and language. 

2,1 Conduct existing behavipr programs in a group * 
setting. " 



2.2 



2.3 



3.1 
3.2 



3.3 



Observe a group setting and pinpoint an inap- 
propriate behavior in measurable terms and 
take baseline sample of the behavior. 

Design a treatment to remediate t{ie pinpointed 
behavior,^o include a* definition, terminal 
objective, metifod of measurement, baseline 
program 'and.,data system. 

Manage a group of children at the. activity 
center. 

Conduct one behavior intervention program and 
record data while managing a group of children. 

Condiict a stimulation program while managing 
a group of children, presenting stimulus item 
and recording chiKI response, i 



43 



1.1.1 



Trainee will score 90% appropriate deli- 
very of cues, consequences and accuracy 
in recording data in any one curricular 
area -on the Teaching Research Volunteer 
Observation Form. 



2.1.1 



Participation in the aide 
in objective #2. 



le as described 



2.2.1 & 2.3.1 Trainee will establish a behavior 

intervention program to include 8 (or 80%) 
of the necessary items, completed appro- 
priately. - 



3.1.1 Trainee will score 85% appropriate deli- 
very of cues and consequences on the 
Teaching Research Aide Observation Form. 

3.2.1 Trainee will utilize^ specif ied treatment 
and appropriately record data as judged 
by trainer. 

3.3.1 Trainee will score 80% appropriate pre- 
sentation of the stimulus and recording 
of responses on the Teaching Research 
Stimulation Checklist. 

47 
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APPENDIX H (Continued) 



Objectives 



Activities 



Evaluation 



The trainee will demonstrate 
the ability to manage the 
classroom in the role of the 
teachers 



*.l Trainee will manage the classroom to include 
interacting with volunteers and staff, modeling 
programs, utilization of observation forms to 
evaluate volunteers and aides and general admin- 
* istration of classes* 



4.1.1 



iinee, when in the role of teacher, will 
"perform 6 of the described activities 
appropriately, as judged by the trainer, 
and complete 80% of items on the Teach-,. 
er f s Checklist on the Teaching Research 
Teacher Observation Form. 



J 
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